9/17/2018 


Solved Problems | Marginal PMF | Independence | Two Random Variables 


5.1.6 Solved Problems 

Problem 1 

Consider two random variables Xand Y with joint PMF given in Table 5.3. 

a. Find P(X <2,Y< 4). 

b. Find the marginal PMFs of A' and Y. 

c. Find P(Y — 2\X= 1). 

d. Are X and Y independent? 
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• Solution 

o a. To find P(X < 2, Y < 4), we can write 


P(X < 2, Y < 4) = P^l, 2) + P^l, 4) + P^2, 2) + P^ 2, 4) 
11113 
~T2 + 24 + 6^T2 _ 8' 


b. Note from the table that 


R x = {1,2,3} and if Y = {2,4,5}. 


Now we can use Equation 5.1 to find the marginal PMFs: 


/ 6 


P x <x) 1 


X = 1 


x = 2 


77 x = 3 


0 otherwise 
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12 


P&)={ 


y = 2 


y = 4 


y = 5 


0 otherwise 


c. Using the formula for conditional probability, we have 

P(Y= 2\X= 1) 


P(X = 1, Y= 2) 
P(X= 1) 
PxA 1 . 2 ) 

PA 1 ) 

1 

12 1 
— ~ 2 ' 


d. Are X and Y independent? To check whether X and Y are independent, we need to check that 

P(X = Xf, Y = yj) = P(X = Xj)P(Y = yj), for all x f E R x and all yj £ if Y . Looking at the table and the results from 
previous parts, we find 


1 3 

P(X= 2, Y= 2) = - ± P(X= 2)P(Y= 2) = —. 

6 16 


Thus, we conclude that A' and Y are not independent. 


Problem 2 

I have a bag containing 40 blue marbles and 60 red marbles. I choose 10 marbles (without replacement) at random. Let A'be the number 
of blue marbles and _v be the number of red marbles. Find the joint PMF ofX and Y. 

• Solution 

o This is, in fact, a hypergeometric distribution. First, note that we must have X+ Y = 10, so 

Pat = ((>>/) I ‘ + J = 10 ’ ij e z ’ ij - °} 

= {(0,10), (1,9), (2, 8),..., (10, 0)}. 


Then, we can write 




40 60 

(, )(, ) 

100 

( 10 ) 


i+j— 10, i,j £ Z, i,j > 0 


otherwise 




Problem 3 

Let X and Y be two independent discrete random variables with the same CDFs PX and F y ■ Define 

Z = max ( X , Y), 

W = min (A, Y). 
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Find the CDFs of Z and W. 


• Solution 

o To find the CDF of Z, we can write 


F/z) = P(Z < z) 

= P( max (X, Y) <z) 

= p{(X < z) and (F< z) j 

= P(X < z)P(Y < z) ( since X and Y are independent) 

= F^F^z). 

To find the CDF of W, we can write 

F n {w) = P(W<w) 

= P( min (X, Y) <w) 

= 1 - P{ min (X, Y) > w) 

= 1 — p((X > w ) and (Y > w) j 

= 1 - P(X > w)P(Y > w) ( since X and Y are independent) 

= 1 - (1 - F^(w))(l - F y(w)) 

= Fjfyv) + Fy{w) ~ Fx(w)Fy(w). 


Problem 4 

Let X and Y be two discrete random variables, with range 

r XY = {(*>/> e Z 2 | i,j > 0, \i-j\ < 1}, 


and joint PMF given by 


1 

p xiii’j) = 6 . 2mm( , v) > for (hi) e r xy- 

a. Pictorially show R x y in the x - y plane. 

b. Find the marginal PMFs P^i), Py(j ). 

c. Find P(X = Y\X< 2). 

d. FindP(l <X 2 + 7 2 < 5). 

e. FindP(X= Y). 

f. FindP[X| Y= 2], 

g. Find Var(X| Y = 2). 

• Solution 
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o a. Figure 5.5 shows the R ^in the x~y plane. 



= X 


= x — 1 


Figure 5.5: Figure shows R yy for X and Y in problem 4. 
b. First, by symmetry we note that X and Y have the same PMF. Next, we can write 

1 1 1 


p^0) = p^ y (0,0) + p zy (0,i) =- + 6 3> 


^D = ^<l,0) + P zy (l,l) + P^<l,2) = - l + 2 2 


+ 1 
i \2 4 4) 


i(i + i + iUl 

6 \ 2 2 ) 3 


P/2) = Pxy(2, 1) + /-VA 2) + P^2, 3) = -1 - + - g , 


P^(3) = P^(3,2) + P^ 3, 3) + P^(3,4) = 


1/1 1 1 \ 1 


6 \ 4 8 8 / 12 


In general, we obtain 


l 

h 


\0 


k = 0 


P x {k) P } {k) 1 _1_ £=1,2,3, 


otherwise 


c. Find P(X = Y\X < 2): We have 
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P(X= Y\X< 2) = 


P(X= Y,X< 2) 
P(X< 2) 

P jpy(0, 0 ) + P 1, 1) 


P/Oj + PJ]) 


l l 



3 

8 ' 


d. Find PIT < X 2 + Y 2 < 5): We have 

P( 1 < X 2 + Y 2 < 5) = Pyy( 0, 1) + P„Y 1,0) + P X y( 1,1) + P X y( 1,2)+ P^ 2, 1 ) 

11111 

— - + - + - + - + - 

6 6 12 12 12 

7 

~~ 12 ’ 


l 

e. By symmetry, we can argue that P(X = Y) = y. The reason is that R yy consists of three lines with points with the 
same probabilities. We can also find P(X = Y) by 


co 


P(X= Y)=Y. p xA‘) 

i=0 


QO 



1 

3' 


f. To find E[X | Y = 2], we first need the conditional PMF of X given Y =2. We have 


Px\ y(^ 1 


Pxvik, 2) 
P(Y= 2) 
6Pxy(k, 2), 


so we obtain 


Thus, 


g. Find Var(A'| Y = 2): we have 


Px\ y(^|2) 


k= 1 


k= 2,3 


otherwise 


1 1 1 

E\X\ Y= 2|=l--+2-- + 3- - 
1 2 4 4 

7 

_ 4' 


https://www.probabilitycourse.com/chapter5/5_1_6_solved_prob.php 


5/9 



9/17/2018 


Solved Problems | Marginal PMF | Independence | Two Random Variables 


Thus, 


, 111 

E[X 2 7=21 = l- - + 4- -+ 9- - 
2 4 4 

15 

4 ' 

Var(X) = E[X 2 \ Y = 2] - (£[X| 7 = 2]) 2 
15 49 

4 16 

11 

~~ 16' 


Problem 5 

Suppose that the number of customers visiting a fast food restaurant in a given day is N ~ Poisson(A). Assume that each customer 
purchases a drink with probability p , independently from other customers, and independently from the value of N. Let X be the number 
of customers who purchase drinks. Let 7 be the number of customers that do not purchase drinks; so X + Y = N. 

a. Find the marginal PMFs of A'and Y. 

b. Find the joint PMF of A' and Y. 

c. Are X and Y independent? 

d. Find E[X 2 Y 2 \. 

• Solution 

o a. First note that R ^ = R y = {0, 1,2,... }. Also, given N = n,X is a sum of n independent Bernoulli(p) random 
variables. Thus, given N = n, Xhas a binomial distribution with parameters n and p, so 

X\N = n ~ Binomial(n, p), 

Y\N = n ~ Binomial(n, q = 1 - p). 


We have 


P x (k)=Y.P(X=k\N=, 1 )P N (n) 

n = 0 


n — k v 7 

" p k g n - k exp(-A)X n 

~tk Wn-ky. 

exp{ - E){Xp) k {Xq) n k 


k\ 

exp( - X)(Xp) k 
k\ 

exp( - A.p)(Ap) k 
k\ 


n — k 


(n - k )! 


~ exp{Aq) 


for £=0,1,2,... 


(law of total probability) 


(Taylor series for e x ) 


Thus, we conclude that 


X ~ Poisson{Ap), 

Y ~ Poisson(Aq). 

b. To find the joint PMF of A'and 7, we can also use the law of total probability: 

00 

Pyy{i,j) = ^ P(X = i,Y = j\N = rijPjfin) (law of total probability). 

n = 0 
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But note that P(X = i, Y = j \ N = n) = 0 if N # i +j, thus 

PxyiiJ) = P(X = i, Y = j\N = i +j)P^i +j) 
= P(X=i\N=i+j)P^i+j) 

(i+j\ . . 

= ( . yWexpi-X)— 

_ exp( - X)(Xp) l (Xqy 
*'!/! 

exp( - Xp)(Xp)' exp( - Xq)(Xq)i 

= 7i ■ J\ 

= }{/)■ 

c. X and Y are independent, since as we saw above 

^XY(?’f) = P) fCO^yO)- 


d. Since Xand K are independent, we have 

£[X 2 T 2 ] = £[X 2 ]£[7 2 ]. 


Also, note that for a Poisson random variable W with parameter X , 

E[W 2 ] = Var( W) + (EW) 2 =X+X 2 . 


Thus, 


E[X 2 Y 2 ] = E[X 2 ]E[Y 2 \ 

= (Xp + X 2 p 2 )(Xq + X 2 q 2 ) 
= X 2 pq(X 2 pq + X + 1). 


Problem 6 

I have a coin with P(H) = p.l toss the coin repeatedly until I observe two consecutive heads. Let Xbe the total number of coin tosses. 
Find EX. 

• Solution 

° We solve this problem using a similar approach as in Example 5.6. Let p = EX. We first condition on the result of the first 
coin toss. Specifically, 


p = EX = E[X | H]P(H) + E[X | T\P(T) 

= E[X\H\p + {\+p\\-p). 

In this equation, E[X\ J] = 1 + EX ., because the tosses are independent, so if the first toss is tails, it is like starting over on 
the second toss. Thus, 


pp=pE[X\H\ + (\-p) (5.14) 

We still need to find E\X\H] so we condition on the second coin toss 

E[X\H] = E[X\HH]P + E[X\HT\(\ -p) 

= 2p + (2+p)(l-p) 

= 2 + (l ~p)p. 

Here, E[X\HT] =2+ £X because, if the first two tosses are HT, we have wasted two coin tosses and we start over at the 
third toss. By letting E[X\E[\ = 2 + (1 ~p)p in Equation 5.14, we obtain 

1 +p 

p = EX = —— 

P 


Problem 7 
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x 

Let X, Y ~ Geometric(p) be independent, and let Z = -. 

a. Find the range of Z. 

b. Find the PMF of Z. 

c. Find EZ. 

• Solution 

o a. The range of Z is given by 


R 


Z “ 


m 1 

— I m, jEN), 

" J 


which is the set of all positive rational numbers. 

b. To find PMF ofZ, let m, n E N such that (m, ri) = 1, where (m, n) is the largest divisor of m and n. Then 



= Z P(X = ink, Y = nk) 
k= 1 
00 

= ^ P(X = mk)P(Y = nk) 
k— 1 
oo 

= V*" 1 

t=l 


(since Xand fare independent) 


(where q— 1 — p) 


oo 


2 (m+n)k 

= Pq 

k=\ 


p\l-p) m + n - 2 
1 -(1 ~p) m+ " ' 

c. Find EZ\ We can use LOTUS to find EZ. Let us first remember the following useful identities: 


CO 


k- 1 


1 


-ln(l - x) = 



for |*| < 1, 


for \x\ < 1. 


The first one is obtained by taking derivative of the geometric sum formula, and the second one is a Taylor series. 
Now, let's apply LOTUS. 
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oo oo 


X X ~p^"‘ ‘q" 


„2 - 1 _n- 1 


12= lm= 1 
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i« 


X -A" _1 X 
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